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ABSTRACT 



A method and apparatus are provided for enabling user 
interaction with a branch-structured narrative entertainment 
(90) in which branch path selection (A,B t C) is made at least 
partially in response to user input A user is provided with a 
non-volatile memory, such as a smart card, in which memory 
is stored data specifying a record of past user interactions. 
This data is periodically checked and updated by the appa- 
ratus and, at one or more branch points (92) of the narrative, 
access to one or more branch paths (AB,C) is enabled or 
denied on the basis of the stored user history. 

10 Claims, 4 Drawing Sheets 
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INTERACTIVE ENTERTAINMENT 
PERSONALISATION 

BACKGROUND OF THE INVENTION 5 

1. Field of the Invention 

The present invention relates to interactive entertainment 
systems and, in particular, to such systems in which the user 
is able to control, directly or indirectly, the path of a 10 
narrative or plot line. 

2. Description of the Related Prior Art 
An example of such a system is described in U.S. Pat No. 

4305,131 to Robert M Best, and comprises a motion 
picture system in which the viewer is treated as a character 15 
in the narrative. At branch points in the narrative, a character 
on screen will ask a question of the viewer the viewer is 
provided with a hand held menu screen on which two or 
more command words appear, which words are amongst the 
limited vocabulary of a speech recognition unit of the *o 
system. The branch taken by the narrative will depend on 
how the viewer responds to the on-screen characters 
question, that is to say which of the command words is 
spoken by the viewer. The multiple story lines are held on 
optical disc as independently addressable video frames, 25 
blocks of compressed audio and/or cartoon graphics. 

In order to further enhance the user's feeling of being a 
part of the narrative, Best proposes inserting recordings of 
the user's name into the dialogue accompanying the 
narrative, such that the actors within the narrative speak to 3C 
the user using the user's own name. Despite these extra 
'personalising** features, the Best system is still somewhat 
limited in that, for each branch point of the narrative, the 
requests for user input follow the same general form. ^ 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an 
interactive entertainment which is self modifying through 
the course of the narrative in response to user input, such as ^ 
to provide a "reward" for or to the user. 

In accordance with the present invention there is provided 
an interactive entertainment apparatus operable to output 
sequences of image frames comprising a user-influenced 
path through a branch structured narrative, the apparatus 45 
comprising: a source of image frame data for all branch 
structure paths of the narrative; branch storage means for 
data defining the narrative branch structure; user operable 
input means; branch selection means coupled to the branch 
stare and operable to determine when the narrative reaches 50 
a branch point and to call one of two or more image frame 
sequences from the image frame source in dependence on 
the user input; and an output for the selected image frame 
sequences; characterised in that the apparatus further com- 
prises a user memory and the branch selection means is 55 
arranged to record therein data specifying two or more past 
user inputs, and to refuse or enable access to at least one path 
from a branch path in dependence on the stored past input 
data. 

The contents of the paths to which the user may granted 60 
or denied access may, far example, contain scenes in which 
one or more characters of the narrative address the user in 
familiar terms. In other words, if the user has not "met" 
(interacted with) the character previously the narrative could 
appear disjointed if access was granted to narrative scenes 63 
requiring the user to have previously encountered the char- 
acter. 
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The types of user input may be divided into two or more 
classes, with the branch selection means being operable to 
determine, for each instance of interaction, the class into 
which the user input falls, with separate stores being main- 
tained of user input data within the user memory for each 
class. This would allow, for example, the maintenance of 
separate user interaction histories for different characters 
within the narrative. 

The user memory is suitably a non-volatile device, such 
as a smart card, such that, where the interactive narrative is 
of an episodic nature (such as a soap opera), the history of 
user interactions with the various characters may be main- 
tained from episode to episode. The stored history of user 
interactions may suitably be in the form of a cumulative 
value, although the store preferably maintains an identifier 
as to each particular interaction such that the oldest stored 
data may be periodically deleted, with only a finite number 
of past interactions being recorded. The cumulative selec- 
tion value may suitably be used by the branch selection 
means as the basis for enabling/disabling access to a branch 
point path in dependence on its value relative to a given 
threshold for that branch point 

Also in accordance with the present invention, there is 
provided a method for control of an interactive entertain- 
ment apparatus, as defined in the attached claims to which 
reference should now be made. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Further features and advantages of the present invention 
will become apparent from reading of the following descrip- 
tion of preferred embodiments of the present invention, 
given by way of example only, and with reference to the 
accompanying drawings in which: 

FIGS. 1 to 4 show differing combinations of material 
source supplying a user interface apparatus embodying the 
present invention; 

FIG. 5 is a schematic representation showing the user 
interface apparatus of FIG. 3 greater detail; 

FIGS. 6 and 7 illustrate differing arrangements of inter- 
active narrative structure; 

FIG. 8 schematically represents the operation of the user 
memory of FIG. 5; and 

FIG. 9 represents a segment of the narrative structure of 
FIG. 7, including a history dependent branch point. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

In the following, we concentrate particularly on the case 
where the image frames accompanying the narrative are 
video frames, although as will be recognised (and as will be 
described), the present invention is equally applicable to 
sequences of animated image frames, and compound image 
frames composed of overlying portions of animation and 
video. 

FIGS. 1 to 4 represent a number of different ways by 
which an interactive narrative may be supplied to a user. In 
each case, the user views the received narrative on a monitor 
screen 10, suitably a television set, and is provided with an 
input device (UID) 12 for inputting commands, responses or 
other data as required by the particular application. In 
addition, the user is provided with an interface in the form 
of a set top box (STB) 14 to which the narrative source or 
sources are coupled, to which the user commands are input, 
and from which the television receives the signal for display. 
The user input device 12 has a few simple controls as 
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required by the application, for example three select buttons structure and program information from the appropriate 

and up/down/left/right shift controls or a joystick, and may sources. Alternatively, and more simply, the bootstrap loader 

be hard wired to the STB as shown in FIG. 1, or connected 54 may just initiate the calling up of the program 

by infrared (IR) link in known manner as in FIG. 2. information, with the first instruction of that program infor- 

In the embodiment of FIG. 1, the narrative video and s mation being far the processor 36 to call up the branch 

structure together with subsidiary information is supplied structure and store it in program store 44. 

wholly froma local data source 16, such as a compact disc Some narra ti V e applications may require informanon as to 

player or CD-ROM. In the embodiment of FIG. 2. the fte cum . nt ^ ^ ^ of ^ ^ to ayoid mc nccd for 

narrauve video, structure and other information is supplied ^ ^ to M non . volaffle< clock sc>urce , 

wholly from i iranote source 18 via a data network 20, with 10 u ^^^ 5tispmS ^^^ ii ^ is f Qaa ^ iaa 

user commands bekg sent to the remote source a return d ^ regular intervals from the remote source 

path 22 of the network. In die embodiment of FIG. 3, toe ^ ^ ne ^ stream D „ shoWB . For me piG. 1 

narrative video and other urformation is supplied as muto- tm ^ taU Zerz there is no remote source, the data/time 

plexedchannefc on a single line 24 from a remote source 26, informationmi g ntbe obtainable from the local source if that 

such as a cable television network server and is supple- , 5 ^^^^ ite ~ wn d<>cfc 

mented by information such as the structure from the local , , . . . . . „_,, . . 

datasource 16. In order to avoid the need for mass memory u Sigi^from us^mput de^ce^ 12 are received 

at the user site a return line 28 may be provided to give the *>y ^^J^^^^^r^^?^^^ 

user siteatleastpartial control over the information sent out P"^. 3 **' " ? ™* ***VIDUis coupled to the 

IhfteenftooW 20 STB via infra-red link, the interface 56 would include a 

Video on Demand (VoD) system from a server 30 over a SUAtable infra-red receiver. 

network 32, access to which may require the user to enter an Some forms of narrative entertainment may be sporadic or 
identification code or insert a smart card or similar into an episodic with the equipment being switched off in between 
appropriate card reader to enable decryption of encrypted * sessions. To avoid the user being forced to re-start from 
signals. As wiU be described, rather than providing separate 25 scratch each time the equipment is switched on, a non- 
units for decryption and card reading, these functions may volatile user memory is provided in which features such as 
be provided within the STB. a history of the users interactions (as will be described), the 
FIG. 5 shows the internal structure of the STB 14 when user's current position within a narrative, user preferred 
S etupfortheconfigurationofna3,thatistosay withinput «y**m settin g s etc ™ st0 * ed - ™ e ™? smt " 
from both remote source 26 via network 24 and local source 30 ably be held on a removable storage ^device ^such tas a ^smart 
16; The incoming signal from the network 24 contains a can* » with the STB having a suitable card reader 60 with 
number of independent service components (audio, video access to that area of the card storing the user memory being 
and data streams)multiplexed together. In this example, the raade ™ user access control 62: user memory access control 
signal contains two data streams D L and D 2 the functions of « may* alternatively, be a purely software route executed 
which are explained below, together with two audio streams 35 within processor 36. 

A l and (for example left and right channels of a stereo In some circumstances, the interactive entertainment may 

audio signal) and two video frame streams V 4 and V 2 . The be provided by a remote server on a "pay-per-play n basis 

multiplexed signal is received by a demultiplexer 34 which with the audio and video signals being transmitted in 

splits it into the separate components under control of a encrypted form and requiring particular key codes to enable 

processor 36. Before being output from the STB the audio 40 them to be decrypted. In such a situation, the smart card 58 

and video may pass through decryption 38 and decoding 40 providing the non-volatile user memory may have a further 

stages, the video signals may be processed 42 to provide function as a part of the decryption system. In such a case, 

video effects such as picture-in-picture (HP), and the audio the smart card 58 would carry a series of the codes, one or 

may also be treated 43, as will be described below. more of which would be required by decrypter 38 to decrypt 

The first of the data streams D, is input to the processor 45 the audio and si ^ s ' Data stream D i would contain 

36 and contains program information specifying how the an identifier for one or more of the codes which identifier 

processor is to handle the audio and video streams and other would be passed to a conditional access sub-system (CASS) 

information specific to features of the particular interactive <*> which in turn would use the identifier to address the 

narrative. This program information is held by the processor stored codes on the smart card (via card reader 60) and, 

in program store 44. A specification for the branch structure 50 havin 8 obtaitted me necessary code or codes from fce smart 

of the narrative may be downloaded via D, (in response to card, the CASS 64 would forward the obtained codes to the 

a processor call on the network return path 28, via interface decrypter 38. 

45) or it may be read from local storage 16 via interface 46, Where the video and/or audio signals are transmitted in 

with the processor sending track addressing and play com- compressed form, for example discrete cosine transform 

mands as required The branch structure is stored in structure 55 coded video according to MPEG standards, the decoder 40 

memory 48, with further memories being provided far may be provided. A switchable by-pass to the decoder (not 

application features 50 and character features 52, as may be shown) may be provided for the case where the display 

required by particular forms of narrative entertainment (television) is already equipped with, and set up for, decod- 

Whilst shown in the Figure as separate stores, it will be ing of the standard. 

readily appreciated that the program store 44 and the 60 The video effects stage 42 is coated under control of the 

structure, application and character memories, 48, 50, 52 processor 36 to provide those features of the displayed 

may be provided as respective areas of a single memory, image which are locally generated under the direction of the 

provided that the more detailed addressing and associated application program and/or user input, rather than being 

access times for the larger memory do not unduly affect present in the video data supplied from the remote or local 

performance. 65 source. Such features may include menu bars, user movable 

On powering up of the STB 14, a bootstrap loader 54 cursors, system messages and so forth. As previously 

initialises the processor and instructs it to call for the branch mentioned, one of the possible video effects is picture-in- 
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picture (PIP) where the in-screen picture may be used to to avoid blocking the on-screen story and may be provided 

provide supplementary or future historical information as, for example, a picture-in-picture or as a pull-up menu 

about the narrative to the user. In one possible arrangement, which the user can access during an interaction period, 

video data streams V, and V, may synchronously show a branch node of the narrative is preferably provided 

particular scene of the narrative being played out, but with 5 ^ a default setting such that, if there is no user input 

each being presented through the "eyes" of a different me interaction period 72, then the narrative win 

character within the scene. continue along the default path without stalling for lack of 

Where the narrative is composed of animated (rather than instruction 

video) images, fte effects stage42 may handle the rendering ^ ^ ^ntto the video sequences of FIG. 

of the images, with the remote source supplying the source 10 ( h ^ ^ deo itsdf but mstead b ^ as a 

and instruction data. Whilst this wouldreqmre a significant featufe of ^ namdvc ^^.^ enables sections of the 

increase 111 pressing power for Ae STB the user interac- ^ M dra]natic „ background music) to be re-used 

Hon could then include modification of the images them- me C0URC rf ^ narrative for lc t0 idc M 

selves* addition to directing narrattvehranch point selec- ^cue instead of, or to addition to , a visual cue indicating 

t.on.THe effects stage may also handle the compilation and 15 ^ ^^on may take place or is now required As 

mixing of compound images, for ex amp e applying mentiolle4 some of this mlJio ^ geneia ted locally, 

remotely-supplied video sprites to a locally-generated ^ fof me ^ structure * 

graphical background. shown in FIG. 7. As before, the narrative starts with a 

The audio effects stage 43 may be used for processing of common imroductory ^ on 70 leadin to a ^ 

the received audio signals A^A, in order to generate effects M node L lattaA of a diverging branch output, branch node L 

such as echo, without requiring supplyand/or storage of access tQ a nma&y( . loop 74 ^^returns to node 

multiple versions of an audio segment The stage may also L ^ ^ ^ foUowing wh ich the narrative continues along 

be used for local generation of some sound effects, suitably m ?6 to anofter node M ^ loop 74 

those required as immediate response to a user input with be used to enable the viewer to access background or 

basic waveform data, call commands and so forth being 23 information to the narrative: the default setting 

downloaded to Ihe application memory 50 at the start of a fM nod£ L would ^ t0 with narrative section 76. 

session or on initialisation. At node M a further ,,^^6 loop is provided having 

Different arrangements of narrative structure may be withln ^ loop a further branch node N and recombining 

supported by the STB of FIG. 5, making use of various of node p linked by ^ possible loop narrative paths 78 and 

the facilities it provides, as required by the particular form 30 go. Mu itjpie loop nestings, as well as loops within loops may 

of the narrative. FIG. « shows a branched narrative structure ^ provided. As shown, the narrative loop structure may be 

starting with a common introductory portion 70, which com bined with a diverging branch structure, with diverting 

would serve to set the scene for the narrative, introduce the branch node Q following narrative section 82 and further 

viewer to the characters and so forth. At branch nodes A to branch nodes R and S leading to conclusion of the narrative 

G a decision is required as to which pain the narrative will 35 ^ onc of po SS jbl c ending X, Y or Z. 

take, with the user navigating through the network of jj, order to "reward" a user for past interactions, path 

possible story lines to reach one of the four possible endings selectioij ^ SQme of ^ narrative branch points is made 

WtoZ.Inorderto avoidan explosion of possible endings, d ^ on me ^ yious Figure 8 sche- 

wbich would require a large amount of video data to be reprcsents how mc uscr memory (on smart card 

available for a relatively short narrative, some paths com- 40 5g nG ^ h maaglid to provide the historical information, 

bine (at nodes H, J and K) such that some sections of the A number of ^dmg scales 8 0 to 83 are provided, each 

narrative (for example H to K) may appear wittinv toe h . a . to to & cmeU yalue p ^ fl central 

narrative regardless of which path is chosen at node A for vahjc D Qn ^a^^n ^ me svstenu M mc ma > s ^ 

example, m order to maintain the user's immersion in the , ^ rf ^ scales fc ^ a ^ value md h 

narrative story line it is important that, at both branching and 45 naveita a respective character or feature of the narrative, 

combining nodes there is no discemable break in the video From $c(t . &t me yalue D (or a 

stream. Detailed techniques for seamless j caning of video user . selected start point) the pointers will be moved up or 

sequences are described in, for <^le, our copendmg fee ^ M ^ usa ^ ^ m interactions related 

United Kingdom patent applications 9424429, 9424436 and ffl character. Using a part of the narrative structure of 

9424437(ourreferenc*s:PHB33952,im33950andPro 50 * J™ in FIG. 9% an example, the user "values" 

3395 1). A principal requirement for seamless joining is that ^ociatcdwith a character appearing in each branch of the 

the system has sufficient time to call up the selected next aaaa&w prior to branch node R may be as follows: 
video segment and synchronise its start to the end of the 
present sequence. To enable this, a finite period prior to the 

end of the present video sequence is provided, for example 55 
as shown at 72 in FIG. 6, during which period the user may 
interact via WD 12 (FIG. 1). The location of the interaction 
periods 72 relative to the narrative is a feature of the 
structure, and is held in structure memory 48 of the STB 

(FIG. 5). 60 

The existence of an interaction period may be indicated to 
the viewer in a number of different ways. For example, a 
menu of possible options may be displayed on the screen: 

mis menu is preferably provided via the video effects unit 42 The decision at branch node R may then be set such that, 
of the STB such that, as soon as the user has selected an 65 if the users accumlated total (the pointer position) is greater 
item, the menu may be removed from the screen to minimise than or equal to +4 then access to path A is rjermitted, and 
the intrusion. The positioning of the menu should be such as an accumulated total of -^4 or lower would enable access to 
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path C, whilst any value between +3 and -3 would result in 
automatic selection of default path B. 

In addition to the narrative sequence character values 
altering the stored user values, the branch nodes themselves 
may have an effect on the stored values, for example * 
incrementing, decrementing or resetting to the default val- 
ues. Also, the default values themselves may be movable 
with, for example, consistent or extreme pointer positioning 
on one side of the default leading to gradual movement of 
the default towards that side, as shown for scale 83 in FIG. 10 
8. 

Rather than wholly automatic selection on the basis of 
accumulated user totals, this feature may instead be used to 
selectively lock or unlock certain paths of a narrative. The 
decision at branch node Q would then be available to the 
user only if they had accumulated sufficient user values 
earlier in the entertainment, and the "unlocked" branch 
might contain scenes where the character appears to address 
the user in a familiar manner, or scenes of personal revela- 
tions from characters. In situations where insufficient user 
values have been accumulated, the system may react to 
user-directed selection is of a locked branch with a displayed 
and/or audio message (generated through video and/or audio 
effects stage 42,43) such as "Path dosed" to alert the user 
to the need to take different pathways on the next play of the 
entertainment Alternatively, where only one unlocked path 
is available from a node, the visual and/or audio cues to the 
user to interact may suitably be suppressed and the unlocked 
path automatically selected as a default such that the chance 
to interact may come as a surprise to the user on a subse- 
quent playing. 

Where the entertainment is episodic, the user is provided 
with a chance to save user memory settings or erase them at 
the end of each episode. By storing the memory settings, the 35 
user reward for interaction may be carried from one episode 
to the next 

From reading the present disclosure, other modifications 
and variations will be apparent to persons skilled in the art 
Such modifications and variations may involve other fea- 40 
tures which arc already known in the art and which may be 
used instead of or in addition to features already described 
herein. For example, some of those features described in 
relation to the STB (14, FIGS. 1 to 5) may instead be 
provided within a personal computer and others within a 45 
television or display unit The reference to an apparatus in 
the following claims will be readily understood to cover all 
arrangements where the various recited features operate 
together in the manner described, regardless of whether 
those features are provided in a single unit or distributed 5c 
amongst a number of interconnected units. 

Although claims have been formulated in this application 
to particular combinations of features, it should be under- 
stood that the scope of the disclosure of the present appli- 
cation also includes any novel feature or combination of 5: 
features disclosed herein either explicitly or implicitly, 
whether or not relating to the same invention as presently 
claimed in any claim and whether or not it mitigates any or 
all of the same technical problems as does the presently 
claimed invention. The applicants hereby give notice that 6 
new claims may be formulated to such features and/or 
combinations of such features during prosecution of the 
present application or of any further application derived 
therefrom. 
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What is claimed is: 

1. Interactive entertainment apparatus operable to output 
sequences of image frames comprising a user-influenced 
path through a branch structured narrative, the apparatus 
comprising: 

a source of image frame data for all branch structure paths 

of the narrative; 
branch storage means for data defining the narrative 

branch structure; 
user operable input means; 

branch selection means coupled to the branch storage 
means and operable to determine when the narrative 
reaches a branch point and to call one of two or more 
image frame sequences from the image frame source in 
dependence on the user input; 
an output for the selected image frame sequences; and 
a user memory, 

the branch selection means being arranged to record 
therein data specifying two or more past user inputs, 
and to refuse or enable access to at least one path from 
a branch path in dependence on the stored past input 
data. 

2. Apparatus as claimed in claim 1, wherein user inputs 
are divided into two or more classes, and the branch selec- 
tion means is operable to determine, for each interaction, the 
class into which the user input falls and to maintain separate 
stores of user input data in the user memory for each class. 

3. Apparatus as claimed in claim 1, wherein data speci- 
fying a finite number of past user inputs is stored in the user 
memory, with the branch selection means being arranged to 
delete the oldest stored data when this finite number is 
reachedl 

4. Apparatus as claimed in claim 1, wherein the user 
memory is a non- volatile device. 

5. Apparatus as claimed in claim 4, wherein the user 
memory is held on a removable card, with the apparatus 
further comprising means for receiving, reading from, and 
writing to the card. 

6. Apparatus as claimed in claim 1, wherein each user 
input is assigned a numerical value, and the branch selection 
means generates and maintains a selection value derived 
from past user input values, and the branch selection means 
enables or refuses access to said at least one path in 
dependence on the current selection value relative to a 
threshold value for the branch point 

7. A method for control of an interactive entertainment 
apparatus, where the apparatus presents to the user a branch 
structured narrative, and user input determines which path is 
followed at at least one narrative branch point characterised 
in that a history is maintained of a user's interactions and 
branch path selection at at least one narrative branch point 
is enabled or disabled on the basis of the user history. 

8. A method as claimed in claim 7, wherein enabling of a 
branch path selection automatically triggers selection of that 
branch path. 

9. A method as claimed in claim 7, wherein the interactive 
entertainment is episodic and the apparatus is inactive 
between episodes, with the user interaction history being 

i maintained and carried over successive episodes. 

10. A method as claimed in claim 7, wherein at least a part 
of the history is deleted at predetermined intervals. 

***** 



01/06/2004, EAST Version: 1.4.1 



